Papers with Wikipedia edit
Corpora Generation for Grammatical Error Correction (N19-1)
Copied to clipboard
| Challenge: | Grammatical Error Correction (GEC) is a computational task that requires large amounts of data to solve. |
| Approach: | They propose two approaches to generate large parallel datasets for GEC using publicly available Wikipedia edit histories using minimal filtration heuristics and round-trip translation through bridge languages. |
| Outcome: | The proposed methods yield similar sized parallel corpora with around 4B tokens and are far ahead of the state-of-the-art on the CoNLL ‘14 benchmark and the JFLEG task. |
HelloFresh: LLM Evalutions on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits (2024.findings-acl)
Copied to clipboard
Tim Franzmeyer, Aleksandar Shtedritski, Samuel Albanie, Philip Torr, Joao F. Henriques, Jakob Foerster
| Challenge: | a better understanding of LLM capabilities on real world tasks is vital for safe development and deployment. |
| Approach: | They propose a new LLM called HelloFresh that uses real-world data to measure performance . they backtest the model and find it yields a temporally consistent ranking . |
| Outcome: | The proposed benchmarks outperform static evaluation data and test data on Wikipedia pages. |